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(57)Abstract: 

PROBLEM TO BE SOLVED: To eliminate the effect of an object- 
shake and a camera-shake in the case of synthesizing plural images 
obtained by pixel deviation. 

SOLUTION: An object is picked up by an image pickup element IMS 
while conducting pixel deviation by moving a lens group L2 and the 
plural obtained images are synthesized to obtain one high definition 
image. In this case, an image pickup area is divided into small areas 
and a shake amount by an object shake for every small area is 
checked as to each Image. When an object-shake is large in the 
case of image synthesis, the image synthesis is not executed in the 
area where the object-shake occurs and the image synthesis is 
executed for high definition in the area where the object-shake 
does not occur. 
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y y ( 1 2 6 ) ttfifj35X5^y (12 4) W (12 
35 5) T#fc¥lSn, l!6^«ciSncOiB*|CS^V>T, BFf^ 

— ^>T»S. SfL/tiaSf^|*l$tt0 2 5«T3tt|?-rs. 
T.'ry-y (12 7) T»aJ:i2X-r-.y:r (12 6) T^fc 

40 [0 0 5 6] e)(±-ei»K»fP*»»TL. (i o. 

2) 'vR*. •tu-cax^'-'y >^ (10 2) -rx-f -y^s 
Wl*t:^-><0ti:jiT**ltfX7^y:/ (i 1 1) mcoi!; 
fl^sisifjjKU-, x-f y^swi*<5r7T?»ntt. x-f y 
(10 3) TW'>xj^-^-f 3>LCPucj*u 

[0 0 5 7] 0 7V*U>X|*?-7'r3>LCPU<i!>i6J?^«; 

«iEX-f y^SWMNO;r>»C,kO, 3c»U>Xflt!)IC*> 
ffi^*<«iS&^Fn$i, X'T-y:?' (1 3 1) iiK)7.9-y:f 
so (1 3 2) 'siitf. Ts'Ty-f (13 2) i;:feUT« 1 S 
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^'frilfi^'ZViii.^itSHeiT^y^'yy (13 3) '^mtt. 
-j-^ (.13 3) »CiJt>TttI S{S«Jh^^©!|»I8iJ?£fTVV 

•T^^y (13 2) I Sf?il:tf>^*«3l5TVi-5^tt 

(1 3 4) 'vii*.. ey^RCX3-:;&lfi]<0tRS 

naijETi'^ii.x— ^» I ACTefltjfr*. t.^v'^ 

(13 2) ^Cl>L7.r-y:7 (1 3 4) «5SfTf 

XT^yp' (1 3 2) J;D;^7^vr (14 1) 
[0 0 5 8] TsT-vr (14 1) Ttti9n«iai-fe>-!J-G 

Rp, GRY^eiftU. try 5=-, a— :&r6]CD^iin^3# 

«A:*-r*. T^'ry'f (14 2) ttH6©:^7^y:/ (1 

12) cffisu. *3t7t«g-r-f3>ccpu®5f^fc«e 
(14 3) -ctt3t^JSox-Att«g, 7:4— 

*-*XX>Zi-^^FENC*^jair*. X?-yy (1 

4 4) Tttjbeexx-;':/ (143) 
w^2(S»t2ROM'r-:7;n*gA»e,Si*.ffl-r. XryT' 

(14 5) TfttXT^yy (14 1) "^f^fc^lin^^i 
X-r-y:/ (14 4) T^fc^2fii»clcS^UTf8iJKnif 

jE7^9^iX-^iACT*is»ii!iys9b, ^jgnt^s 

[0 0 5 9] XT-^r (14 6) Ttt^7pl7W-7-f =I> 
DACT«^UX«iODFMSSKB(jU. JtSaWaUT-B. 

XT-yy (14 7) TttA^t^i'q-^'f 3>ccpu*>& 

x-:^FACT««BSftt. ^fejSSSKfr*. X^^y^ (1 
4 8) Tfttamr^LOitJbco^'-f *>i//t;U7.®S^ 

UViiWt. 7.^vf (14 1) ^SnMiE, US 

(148) r^'^f 5>d»'/t;p;^03S^«ttS-r«4:, X 
T-yr (14 9) 'vj^tr. 
[0 0 6 0] 7.^vy (14 9) t?ttiiiSR^^,L-<Dfc«) 

OSHEiKJ^Slfc^f X7^';^y (15 0) Tftt-hffiX 

T^vT' (14 9) -c^^i^ytBijR-rebsqsatjKfc, 
T^v/:/ (14 4) -css*ttiLfc«i««*iRi;fcM3sr 

[0 0 6 1] Ts^'jrr (15 1) T?tt;^^7fg-e'fn> 
CC PUTi^ePIiiiK-re U^T<g#«<M(g$nTt»SA^5 



4#§8SF 10-191136 



(ri;^j:l,i(D-eXxvr (14 8) '^KO. :^<05'-f*>y 

/i;i'X<oa<gef*o, •«-L'-r;^^'yr (i 4 8) ja;v»L/ 
XiP-y:/ (1 SO) «^^@8t^AfiLv ES*r*SLBiMP 

05 T^T-K/Zf (1 5 1) ^OXt^v:/ (1 3 2) 'sKS. 
VX7.^yr (13 2) -CI S P§J&t5}j<^SS^-&r. X 
(13 3) -^I SfPjt*^^5EggUfe9. ;^'r-y 
y (1 3 4) -C=«H@n4i8jE7^5^iX-^' I ACT**? 

10 [0 0 6 2] B8Vi±KH6&C;fBI7cr)7D-KJ;-5* 

^ 7sr;u>xoK)f^&awr«^'-f s >tf'f-^r~ kt 

a62>. (a) . (b) 14^'n-€=n;<J^t^<DW'J-XJ}?3' 
^fCgS&UfcX-f yf=-SWl, SW2<Dttf!g*:*T. 

(c) ttiS9S-re.bo^'fs>i^iM'faiwh'j;ym^-e* 

15 a. (a) W«H»5B5'IMSO«WSa^r-TS>5^*3i 

r. (e) . (f) «l^'y^Rtf3-:;?|fil«)iiSl3g'r^U 

^mm^^t. (g) , (h) tt^isn-fe>iJ-GR 

20 (i) . (j) f*fi«SniiSiEMS52 V>X»© 

[0 0 6 3] etT, l2|8*fflV>Tia6RtfBJ7©7D- 
^^ttt^xmSLt^b, ^igij t, tCiJViTX-fvf^SWl 
*t:j->3Fn*4:. ^iSnia^ (g) , (h) ffimij^n 
25 S. "TSt, CC?©#CSfS2«ftS*i;/S:filC«eoTaS 

2^>x»L2A*jsjg (i) , (j) <o^h<msium 
30 XTP i*t«^$n-5.. t--5t::n*SJtT, ffliSjR^ 

*.tBL/t*fC, 3-:*'|Cj©SiJ{?i"e.L.«ipi8Ejg (f) A< 

35 56^^n«. •r<54:3-::^ifijwu>x^itt (j) tt. ± 
aBi£t(eait^ (f) ic^i^iit«mi;/^fis^f)a^tin4{i 

[0 0 6 5] flJSiJ t „^^^S05fajf5ia®OK?SiI t 
ffl)J«iJ?T-r^&i, ^Saai?f<Dtei^- St«.WL.t^t»C. kT 

y^-^^om^-Vfbx^iisv^T^m (e) ;j<5Sifesn*. -r 

Sttfy5^:»l«10U>X«ffi (I) t). ±E3SJpiffijg 
45 (e) J::»ltS»*f^i;fcf£<i:65gH*lStm8IEjKJgtS 

[0 06 6] i^M t „*»&msi^pgjas«©n5^j t 

iHi« icffiii»*T- 1 M s 14. t „A» ^ mn t „©wp=T 
50 4'»cs7teS5®«Sfsa«fT5. ^\.T^mt„-vmM^ 
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~7t\s)(Dmm-r^vst^ni^ (f) vsyi(Dmzm-sri 
t-?.i3->&rfi)<ou>xs5{a (J) #3gnttiE 

1 0 0 6 7 1 t „A» (^mAm-it^M^omtfi t „IC 

!y5^:&isjoiii3gr^LS«P«JK (e) t>7cofia»cMan 

[0 0 6 8] ±^mSKnmiEiBi.zfm9ii-r&vmm^(om 
sot,,, tj,. t„, t^p 1 5 lc:feit5^<^(ftEfiB(r 

i£®ia4ICt>V»T. -en^'niMl. IM2. IM3. 
I M 4 , I M 1 Q . S«lO±T. a£:&©ttteA*IS* 

CR=l-2: lABS (IM2 ( 
M2 (I) ) } 

itnvABSi-imm, ittaijRS^, ztti = i*>5 

i;tta. ;::g)*«JE*St„, =-2. CR„, ^it* 

t>-r. 

[0072] miO (a) » 2 %OIii{S!r»°IK(7&f liistsro^i^ 
<D&iSc«<i:(^ft;'^&i!g^ (MlBlTUl. 5iii?^) OfSim 
BT»S>. 1910 (b) it^2<OmQiiS^lMZ^lE.:)S 
|6llriil3RJJ->7Mx/it>«3T. fflMlfiCRttO. Si: 

R«l fctt/S:e>i^tt». 
[0 0 7 31 CO05«?a3!S5':? hffSTt«M«iCR«> 

iSi3gv'7 hSST*+2*»6.-3*'T?^fb$'tt&7*«S4a 

T?tt»lscR*t«*«o. Sift*. -tc-rffiMgecR 

«. tfJ-t}-^. ST„,=-1. 5. CR„=0. 9 

[0 0 7 4] ±s.(D^mi-s.2WL(7)i-A7tmmz^if^m 

ffl®2:s#:7Eiil«ifcfctts±Ts £«:Srifij©«irtia'bff 
aiT*-5. ^<*w»3«4f wna 6 4 - 1 0 7 8 m<ii!Wt 

J^DSKOat-^i? h;i''r;ftip^±Tv S;:&:©|n)©«S(iTn 
fi$j^aJT#s. 2^5i;(fii«»?&2Mj'|fi]fcira;*:r 
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[0 0 6 9] ^(:B9/j:ulyBl S^ffltr^TiiijS'r 
10 [0 0 7 0] 0 9 (a) OIMK^^'&II^^JiCQlt^dFn 

«»ria»anfciS2®iaii«<5^m(otij*-c. wsisiii® 

[0 0 7 1] :i ^ITf 2 iS{lk<OfilHS (Correlation ) C 

i)-IMl (i))/<IMl (1)+I 
(7) 

[0 0 7 5] 0 1 2tt. #jSn<D5JS«SttrtCiE«IJ&: 

iSiSUTifi*. igi2fc*3iriT» fiiioa&s;jS;>*fcT© 

» (ffl«iK^<osfffaFaRafsst*iiib) sir-?, ssv^r 
*jp5EffSj (^iinitiE<^3-^iaic**;6:) CO. 5a?gs 

30 faW^^oa-jR-f*^ U*fTt5T»{4BS I M2 iCgPSb* 
•fr. SB2 0Iii|»{5^S:^^-rs. 
[0 0 7 6] B 1 3 (^JiSBB 1 2 T^^U/t^ 1 ;&tJ^m 
2 Oia«lg<*0«HR C R «SRTH"T?* WWW 2 iffi 

3S Tf, 7K*:&|pl©>'7 ha*STH. iiiE:;&|i!Q<^2^7 hfi 
tSTVtbTifeS. <a«iattfflHSCR'^»*, H'l'O 
CRHtt, 2i!aC!>23*:7Ciiifii**¥3^iajlCffl>#WKST 

[0 0 7 7] IlCTBIl 2CDP;teT6U«7K¥^:^[a]<0i!». 

I6)) »cttr^LT(r^;feVi/5:«e), fflKffiC RAtfikzfet^t* 
lffl5!l->7 hS (::ti&K>!:«M->7 hat«;f ) tt. S 
45 TH„, =-0. 5, STV„. =0 tJS:*. ^fcc:© 
P*<OffiMliea;kilSC RH„. . C R V„ « 1 feS^T 
(5l5lfit/j:S. Cin«, «lS^KSB2©lS«A*liisR|g|W 

50 mmmm-f^ L«:fT-pT(,i«C0iJlT:!5|nJCO(.»T*,^ 
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[0 0 7 8] 123 1 4 tt, mmT^vrnf^Vizx^Ti^M 
iETomm±<D,^ I M 1 \ziiL(s-r^vt$Si-vf5 1 

0. 7+ (-0. 5) = 
0. 3 + 0 = 0. 3 

[0 0 8 03 n:i-c. *ifeJS<o}gJg-ctt¥Jsn«iiE«« 
ntt«»iiiiao^is»ca!i^T-iRfc«fei;«. ?s^t. et 

[0 0 8 1] ;fc(C01 6/j:I/^UBI1 7%fflurt&9ik;a> 

<.iTi«?B-r-5. H 1 6 «ja»mT 1 M s <Dm^nm±\t 

ie»^nfc«¥<Jsf8i«*-ra-tf. iiii5«fitilc.^tl!t2§CflcO 

B M»2:*asr * A«ii*t, •E-©»:&fc««£«^<^o b s 

Aife<^>— fBf & t>"6 W fcSb v>T v» 4 1) o t "T 

s. 

[0 0 8 2] Bl 71ii.Sl 6 03m.<94^^mm'r^l'VU 

u ^^Mum 6 nr u s ^ . 

[0 0 8 3] 018 \t±]&<Oi^Tj.m.^<DWiiS\ZJ:i>m 

SXiiai 2 = 2 1 6<Drbm^A.R (k) It 
^>W**T.S, (k-1— K. K=2 16) ^VXikiA^ 

■eCTa-®«AR (k) iC-^tiT. tft5EO309/J:tiHa 
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IC. ?g2W6i«<3^S]R^L/TVi2.. 

[0 0 7 9] lai soLhSBiai 4xiKf&u;tsgi s.ac^ 
2 0Hi(ft{g^©fflKSCR*^-rH"^. Hl'O&S-^li 

05 :*:ffira->7h«aWSTH„,=-0. 7. STV„. = 
- 0 . 3 tU^, -^-CTH 1 3 C:feW«#*in7><M^ie 

. 2 (8) 

(9) 

IS CO 0 8 4] ISIl 9(3191 6(iD^7f(ce(i!D;KT&L/L/rj: 

*>©T, a«rifcBit*^trg5»-^ia*nfcM«ARMv<D 

[0 0 8 51 Bl 2 0 ttJiS2i3UEn«iaiiKStSt^#. H 
2s <o5-fe. Bf^cDia. eij^iiSJiaaroiBiflMt^a)** 

30 ^* 

(0 0 8 61 '^\zm2 1RZ/S2 2€:ffitiTgi*TeU 

35 Eil2.10 (a) tt04T?'t2tt?^bfc'b©-C, 

1 I M 2 -» I M 3 I M 4 -♦ I M 1 0 Jta C» ftf * 

t«35Lrui. riaH-?-<oT<o (b) <o:::ri<. :^:sHi 

c!?«iK»UT*a»3j4^©ifl:e7i« i g i - 1 g 2-^ i g 3 

40 -*1 G4-I Gl6jlBK:»»-r»©fc:^<««lfl-?»*. 

^*iGi (I. J) tra. cc-c=fla«RjR^tt cmx 

n) iS5ROXU7-fe>-y-T-SS. iRltSiCi G2, IG 
3, I G4K:ffi5fit-SB#oaj*{5^* I G2 (i. 
45 j ) . T G 3 ( i , j ) , I G 4 ( i , j ) 

10 0 8 7] :LtlSAia.<X>m».iB^<r>'^^^^t:tSiH^V 
fc'&<0«<H2 2T««. 4i!a<0 (mxn) Psg©©^^- 
(2mx 2 n) ®i?ROSTfc;^J:®iRf5 I M 

G (u. v) iz-r^, ^vxmmts°iMG (u. v) 

50 <D£Jb<D4Bi5gH, 4a<D7E©ia?g$-BIOCrt < J»*..v/: 
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T MG (u = 2 1-1. v = 2 J ) 
IMG (u = 2 i -1, v = 2 j -1) 
IMG (u = 2 i. v = 2 j -1) 
IMG (u = 2 i . v = 2 j ) 

[0 0 8 8] ±BB<^>;5rffitt. ?4in. ti!c5?fp:|gnA<«; 
<. ^iaSi*^iii?gr^LtcJ:i3SJ5ffl<kBIfiE;5:«^©iii 

IMC (u=2I— 1. v=2j) 
I MG (u = 2I-l. v = 2j-l) 
I MG (u = 2 I . v=2 J - 1) 
I MG (U=2 i . V— 2 J ) 

CO 0 8 9] -rjifcs, tt^^iin*i«c<, (1 0) 

fci6. ^ (14) U^^V (17) icffi^fciiilft^fiE^ff 

dis«ii^, »^i9i«fli^-r«a9ig%»i£(iu<4«(cie 

^•5. 25 
[0 0 9 01 U^. SJikO^OL^mit. &mi&»^=f-^ 

[0 0 9 1] 02 SttiSHgitcl-^L/Bl STSaigLZt: 
o— H-^'. HSOy^T'y:/ (12 4) 0^fin*)3fe-y-^ 

'^■fT.'rv-f (16 1) -ew, M 

9Rr^b0fSc*C7>^'CNT«:OK^!O^<bf 5. 35 
:/ (1 6 2) Tftt. ffiJEost (7) fc«6oT»iac;?B 
2 Oili«t<i^«a®ffiM«*»ST«. X^ry:^ (16 

3) ret. ±.'^iismms.^s.t\t^, fkxne^V'-y v&s 



[0 0 9 2] ;^^yr (1 6 4) Ttt. «BMSES:*;IISC 40 

T-«. «ugngfi„. a,€rsm-r«. T.T-yzf (le 

6) "Ctts *':/>:^CNT>Zl *iH1^T|£iSrt"S. 
^/T' (1 6 7) Ttt. *9>^'CNT4:Ss!Sr<SHlI» 

(16 2) tS.\^Vyk7-V^ (1 6 5) © 
JSfittt. fBl taS2 0af?lfS^*av»2i:SI53<Dfi3«HS 

•^■ffl. ®3 tm4©ia^^^a®ro'jt?^sf siHifT^^fc 

r/::/ (1 6 2) tBioX^©SI»^S^m»t^r«7.7^s; 50 

- IZ - 



— I Gl (.1 . J ) (10) 

•^IG2 (i. j) (1 1) 

*-IG3 (i, j) (1 2) 

-I G4 (i. j) (1 3) 

3C (10) (13) lc:J:2»iii«SfiEf>C©/htS« 

UTU««jyET?tt, 4Jfl<^®»<D^fi£cr>f^t)<9»Cia<0 
IiJ«l©*-«:fflVJfc®»?gj««fT5. COWiJijC (1 
0) (13) ©f^tjIJIC^^UiC. 

— I Gl (i. j) (14) 

-I Gl (i. j). (15) 

«-I Gl (i. j) (16) 

•-I G 1 (1 . J ) (i 7) 

(1 6 2) UX^'^y^yt^T-^yZf (l 6 6) ©mai'*:»*)jS 
U*ffr*. CNT*tNs,-ltcUSlxfc6. 
(16 8) iCjfit^. 

[0 0 9 3] T.'ryZf (1 6 8) Ttt, mlSB;:^?"';/ ^ 
(16 5) -esi-39cixfcir-<r«9«isnfi»c:o(-^-r, 

lis « , J: 0 »t\.Mt, ^mtviti:.!£>mmn\t.wiiiiu 

-C^-stWISrb, (16 9) lcT^JSn©58^fe 

*IS*>"r7^5^FLHD*-KDi;:-fey hra. — x 

T-:/:/ (16 8) »ifet»r. 5hSL&«a*iao5fe. 

(17 0) \zmhj-v^mt\.y 5 ^ F L H D K 1 efeiwr 
(16 9) scv^raj^xyr (i 7 o) 01TT 

attJ^T'y^ (17 1) KlJfi*. H6 0j!<'f >7D— K 

[0 0 9 4] BI2 4«HaSBEIl 8&CJCE31 9Tsaiqb?c 
T^n— Bl-C, BI6<DX7^y:/ (12 5) (D»3^(4i:|Eitl 

*y3t-y->^;i'-^>»-t§^'ri.. st;^?"^:^ (i 7 6) 

rU. «1fftm^%Sll 8<9Cr£:<KIScO/J>ffi«EAR 
(k) IC^^SUr*. T.'ry^ (17 7) Ttt. 
^SCSJifiAR <k) iZ-DUT, «Jin?|J3[«ff 5. S«c 
WfcttHZ Z<r>7.'rv^ (16 1) (16 7) W 

iS»«i8sra/hffl«AR (k) fc-pv^TfT«r». -eois 
[0 0 9 5] y^'Tvf (1 7 8) t?tt, easBXT^yT' 

(17 7) -CgJ-J^UfefilJinttCol/iT, mj^fiSdji 

D-C»«t*iJ»?U. :^^'y'/ (17 0) K-ctt^Jsn 
CD5Sife?£-X3bTr79i^FLOB (k) «-tfai:-t ,y 

5.. — ;^7.y-y:/ (17 8) li^viT. ffHSU/tiftiin 

SOT^S, lOTt,m$€a,«fcO:*:«^*'b«©;5t^,t^^^ 

;^.7-s/:;'' (1 8 0) cMA/Tffi^iicsn^^ii'FLOB 
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(k) tCli^&Jrtt-o. Xy^-yZ^ (18 1) "CttiSByt 

Ty-;/ (.1 7 7) tj.^iiy (18 0) **»8>lUfc-d--<:Ta> 
fT*^Ta6n«^T-yy (17 7) ic^oT*^fT©fia 

7.^-j-7 (1 8 1) .fcOXT^vr (1 8 2) \Z. 

■5. 

10 0 9 6] ^2 5(»ni>a5BI2 0;^<r^Ug|2 2T3iiQL/ 

(12 6) <Diiitft'&E)2-y-r;i'-^>Cffi^T5. ^TTX 
r-y>^ (1 8 6) Ttt. iS^r^ 

*ff-5. A«E6*;lcttv 0 2 soytT'yy (i o 9) sJivi 

\i.7.7-v^ (1 7 0) -CEax^*nfcg^ign7 5>i'FLH 
T¥isn*t:fc€rum*. T.T-v'f (i 94) K:s^-»'>y 

L'T^iStlSftSfTl'i, T.T-y-f (.19^^ CT;K'f > 

-'I'— y^9-y-:f (1 8 6) -^^isn 
^nfci^tt. T.T'vy^ (18 7) fcjitr. 

[0 0 9 7] 7.=rv:f (18 7) Ttt, HI 8»C*HT 
iJ-Sl^nfc/h®«AR (k) fi©«:¥«i:|gn«^^f75 
fc«>«>3l«k*-tfD»c;U-fe>y HT*. X^ry:/ (1 8 
8) /hfiSi^AR (k) CD«t^<4:lin<^;A:f?3*iJ^ 

?£fT^. :af|c6<jK«, E2 4 0Xr-y:f (17 9) 

vs.7.Tyy (15 0) -cWi.s.^mt.wi^i^mtiyvcrT 
LOB (k) oi*gS*i|;^*?fe). •?-bTa:?«t«*i79 
i^FLOB (k) :i5nT«^il:Stid<:*;^<ri«fttX5^v 
y (1 8 9) JCii*, 2C (1 4) J^^tiU (1 7) *fflV> 

(0 0 6 8] —■^Ps'T-yZr (1 8 8) "Cit^lSn^? 
yPLOB (k) ;»tifD, ■r<tt)S»a?«|£i6nA*'hSJ'» 
t-flJJt^Ftl^f^ttXT-y:/ (19 0) JCJi*.. St (1 
0) Jil'iL. (13) ^&fl!n/i:4e«KJ;51ifil^fi8efT 
5. (18 9) sS;t»tt (1 9 0) ^tr^ttXT*- 

v:/ (19 1) \zm^.. §l»kf:i €:Jn^TM«f^S. 
7.7- (19 2) -cttSISSckA^hSlffiAR (k) ©^)- 
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